An Anthropic Argument against the Future Existence of Superintelligent Artificial Intelligence
نویسنده
چکیده
This paper uses anthropic reasoning to argue for a reduced likelihood that superintelligent AI will come into existence in the future. To make this argument, a new principle is introduced: the SuperStrong Self-Sampling Assumption (SSSSA), building on the Self-Sampling Assumption (SSA) and the Strong Self-Sampling Assumption (SSSA). SSA uses as its sample the relevant observers, whereas SSSA goes further by using observer-moments. SSSSA goes further still and weights each sample proportionally, according to the size of a mind in cognitive terms. SSSSA is required for human observer-samples to be typical, given by how much non-human animals outnumber humans. Given SSSSA, the assumption that humans experience typical observer-samples relies on a future where superintelligent AI does not dominate, which in turn reduces the likelihood of it being created at all.
منابع مشابه
The Future of Artificial Intelligence
The first questions facing the development of artificial intelligence (AI), addressed by all three authors, are how likely it is that humanity will develop an artificial human-level intelligence at all, and when that might happen, with the implication that a human-level intelligence capable of utilizing abundantly available computational resources will quickly bootstrap itself into superintelli...
متن کاملThe Anthropic Principle and the Duration of the Cosmological Past
The place of an anthropic argument in the discrimination between various cosmological models is to be reconsidered following the classic criticisms of Paul C. W. Davies and Frank J. Tipler. Different versions of the anthropic argument against cosmologies involving an infinite series of past events are analyzed and applied to several instructive instances. This is not only of historical signific...
متن کاملAgent Foundations for Aligning Machine Intelligence with Human Interests: A Technical Research Agenda
The property that has given humans a dominant advantage over other species is not strength or speed, but intelligence. If progress in artificial intelligence continues unabated, AI systems will eventually exceed humans in general reasoning ability. A system that is “superintelligent” in the sense of being “smarter than the best human brains in practically every field” could have an enormous imp...
متن کاملFriendly Artificial Intelligence: The Physics Challenge
Relentless progress in artificial intelligence (AI) is increasingly raising concerns that machines will replace humans on the job market, and perhaps altogether. Eliezer Yudkowski and others have explored the possibility that a promising future for humankind could be guaranteed by a superintelligent “Friendly AI” [1], designed to safeguard humanity and its values. I will argue that, from a phys...
متن کاملv 2 2 1 D ec 2 00 4 Multiple universes , cosmic coincidences , and other dark matters
Even when completely and consistently formulated, a fundamental theory of physics and cosmological boundary conditions may not give unambiguous and unique predictions for the universe we observe; indeed inflation, string/M theory, and quantum cosmology all arguably suggest that we can observe only one member of an ensemble with diverse properties. How, then, can such theories be tested? It has ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1705.03078 شماره
صفحات -
تاریخ انتشار 2017